Safe and Eeective Importance Sampling
نویسنده
چکیده
We present two improvements on the technique of importance sampling. First we show that importance sampling from a mixture of densities, using those densities as control variates, results in a useful upper bound on the asymptotic variance. That bound is a small multiple of the asymptotic variance of importance sampling from the best single component density. This allows one to beneet from the great variance reductions obtainable by importance sampling, while protecting against the equally great variance increases that might take the practitioner by surprise. The second improvement is to show how importance sampling from two or more densities can be used to approach a sampling variance of zero even for integrands that take both positive and negative values.
منابع مشابه
Stratified Sampling with Spherically Symmetric Importance Samplers
SUMMARY Multivariate normal or Student importance sampling is a commonly used technique for integration problems in statistical inference. This integration approach is easy to implement, has straightforward error estimates and is eeective in a number of problems. A variety of variance reduction techniques can be considered with importance sampling. Stratiied sampling is one of these and in fact...
متن کاملStratiication Issues in Estimating Value-at-risk Stratiication Issues in Estimating Value-at-risk
LIMITED DISTRIBUTION NOTICE: This report has been submitted for publication outside of IBM and will probably be copyrighted if accepted for publication. It has been issued as a Research Report for early dissemination of its contents. In view of the transfer of copyright to the outside publisher, its distribution outside of IBM prior to publication should be limited to peer communications and sp...
متن کاملCoarsening, Sampling, and Smoothing: Elements of the Multilevel Method
The multilevel method has emerged as one of the most eeective methods for solving numerical and combinatorial problems. It has been used in multigrid, domain decomposition, geometric search structures, as well as optimization algorithms for problems such as partitioning and sparse-matrix ordering. This paper presents a systematic treatment of the fundamental elements of the multilevel method. W...
متن کاملSafe Adaptive Importance Sampling
Importance sampling has become an indispensable strategy to speed up optimization algorithms for large-scale applications. Improved adaptive variants—using importance values defined by the complete gradient information which changes during optimization—enjoy favorable theoretical properties, but are typically computationally infeasible. In this paper we propose an efficient approximation of gra...
متن کاملVariance Reduction Techniques for Estimating Value - at - RiskPaul
LIMITED DISTRIBUTION NOTICE: This report has been submitted for publication outside of IBM and will probably be copyrighted if accepted for publication. It has been issued as a Research Report for early dissemination of its contents. In view of the transfer of copyright to the outside publisher, its distribution outside of IBM prior to publication should be limited to peer communications and sp...
متن کامل